A frame signature matrix for analysing and comparing interaction design behaviour

Protocol studies are an established method to investigate design behaviour. In the context of a project to investigate novice interaction design (ID) behaviour across protocols and cultures, we found that existing design behaviour analysis frameworks did not provide reliable results. This paper describes the development of a new approach to analyse and compare ID behaviour using verbal protocols. We augment Schön’s basic design and reflection cycle with construction of a frame signature matrix and analogical categorisation coding. We demonstrate this approach by comparing two protocols of novice interaction designers in Botswana. The initial findings indicate that this approach increases consistency and accuracy of coding, and that there are different degrees of reframing for the design problem and solutions

A protocol study of novice interaction design behaviour in Botswana: solution-driven interaction design

Think aloud studies and protocol analysis are well-known in the field of HCI, but most often these studies focus on usability evaluations, or on the use of technology. Rarely are they used to investigate the behaviour of interaction designers. In this paper, we report on a protocol study with novice interaction designers in Botswana. Participants had just completed the design section of an undergraduate module on Interaction Design that actively promotes a problem-driven approach to the design of interactive products, yet the participants behaved in a way that is closer to a solution-driven approach. The module emphasizes user-centred design, prototyping methods to support design development, and evaluating design detail. Yet participants suggest solutions before exploring the context of use, use prototyping methods to capture, rather than to develop, designs, and do not produce detailed designs. In a problem-solving context, some of these behaviours are typical of novices, but in a design context they are also seen in experienced designers. The results presented here reveal the detail of the approach adopted by these students, and contribute to the wider debate concerning the internationalization of HCI education

Co-evolving problems and solutions: The case of novice interaction designers in Botswana and the UK

This paper establishes that problem-solution co-evolution is observed in novice interaction designers in the UK and Botswana. However, in the majority of Botswana protocols we could see a new type of co-evolution, which we termed solution-problem co-evolution. Solution- problem co-evolution uses ‘off the shelf’’ solutions to structure the problem space. Both types of co-evolution are described and discussed in this paper. The findings are drawn from the analysis of 18 (5 UK, 13 Botswana) 1-hour design protocols from two cohorts of students studying the same undergraduate Open University Interaction Design module, one in Botswana and one in the UK. Participants were required to complete a medical interaction design task under controlled conditions. We based our analysis on a coding scheme that was developed specifically for this protocol study. The coding scheme is based on Schön’s seminal work on reflective practice. It visually represents activities in the problem and solutions spaces

Framing behaviours in novice interaction designers

Some recent findings with expert designers relate problem-solution co-evolution and analogy use to framing practices. We wanted to understand if novices also use coevolution and analogies to frame their thinking. Furthermore we wanted to see if there are any differences across cultures. The paper reports an analysis of data gained from protocol studies with novice interaction designers in the UK and Botswana. Novice interaction designers in the UK and Botswana show some similarities in framing behaviours using co-evolution and opening analogies to develop metaphorical themes in framing. But within these observations we also found differences across the cohorts. The implications are discussed in the light of adopting appropriate design pedagogy for novices in different cultures

Socio-cultural factors and capacity building in Interaction Design: results of a video diary study in Botswana

This paper presents the results of a video diary study that was conducted with ten novice interaction designers in Botswana, to investigate socio-cultural factors (SCFs) in interaction design. The overall aim of this research is to gain new insights into design behaviour in different cultures in order to inform international interaction design capacity building. To this end, this research investigates what SCFs are considered during the design process, which are accounted for in prototype designs and which interaction design concepts participants use to implement SCFs in their designs. The results reveal 13 categories of SCFs considered during the design process, 10 of which were implemented in prototypes. Participants used five main interaction design concepts to implement SCFs: simplicity, wearable devices, accessibility, universal design, and conversational interaction. In addition, they tended to rely on adaptations to existing products rather than creating new designs. Recommendations for capacity building include the need to identify concrete examples and alternative interaction design concepts that focus on a wider set of SCFs; and to draw upon the synergy between local product design practices and interaction design practices in order to learn how to transition SCFs into interactive products